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/ . ie watyeata — ‘delicate balance between: student a demand& of - 


af 


the. society in which they are to become responsible Sontetalianiea and the 


oo 


fesoirces aval lable for preparation programs, ‘educators Frequently, conduct | 


needs désesements and ‘evalyation studies. Such _studies,are prinirily for. 


ae eS 


f* / “gnternat, uge by, those ‘educators inmediat¢ly involved and focus sélely on av 
com 5. ee a « . 
a “educational questions. me ; . -! 
ee ‘ Ag federal legislation ‘increasingly reflects a view that education’is + o 
“7 A : : 7a ; ‘ 


a vehicle for implementing social policy, educators are often required to 


conduct studies of their programs for external use. Such studies supply/data 


. 
' 


toa federal- sagency, with the agency often seen as+ impersonal and pong from , /¥ 


". the daily complexities and optrations of state educational progran "the 


missions of the federal agency are viewed as that of a "atchogy/and a ."time~ 


: table monitor” for the implementation wk ‘federal policy. wa /not unusual ~ od 


for a atase educational ‘agency to find: itself reacting tq th e@ sienionn: ‘by 


f 
supplying information ‘end, conducting 2 oe studies. Yet, state educa- 


: . anws ateneies appear to have litt e sip udace over the: usage of evaluation 
federal ftnterferdnce and un- 


studies which may ‘lead to what is views 


reasonable demands. ‘ 
‘ Perhaps, even more significa ly, administrators of state educational 
1 i 4 ~ ‘ > 
programs appear to iar iat ad ‘ put‘ into the phrasing of the evaluation 


jae Thus, educators /are ften, required to Sonduct an seca study: 
¢ 


f used on essentially polfgical question Instead of an educat {onal qQuestion.« 


co oo ; ) . 
° However, to conduct a evaluation study strictly within the political realm , 


fa eo ae _—— SO 


srepregentation of an educational 
e 


state 1 spltutioris and Aederal agencies. 


Althoigh not inifev these observations are based upon dav gathered. by 
fe, 
() writer in a two year Sud conducyed in the teacher "education programs 


BS a =f 
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a Virginia state Supported ‘four+year inskitutions to -qssess the preparation 
of teachers to work effectively with minority group stydents.. What is unique 
rs ; . - ” . ° , 

is the various ways which polit{cal behaviors were manifested during that 

s 


two-year -period. ‘The context in which these ‘behaviors o 


urred was the 


evaluation process for the study} sponsored by the state Association. of 


Colleges of Teacher Education} submitted to the Stafe Council of Higher Educa- , 
. P * - \ 


i ‘tion of Vir®inia, and forwarded to the U.S. Depaftment of Health, Education, 
' e ™ 


and Welfare. This papar focuses on >)‘ the DeAns Committee and the 
; eH 4 ‘ LY 
evaluation design, by the attempts by the Association to modify the evaluation 


4 focus, 3) the ity of muitiple kind 


of data, and 4) the'initial impact 


of the study. 


The Deans Committee and the E 


tiny 5 


Ps i e ‘ . ‘ 
. In the early 1970s, W notified ten states of possible violation’ df , . 


itle VK which requiked that: : Can 

¢ ' ‘ 

a 4 "Nq persgn ih the United States shall, on the ground lo as 
e 7 “4 of racy% color, or national origin, be excluded from , 
partifipation in, be denied the bencfits of, or be 4 e 

cted to discrimination under any program or activity . =a 

iving Federal financial assistance." ; aes 


the 1964 Civil Rights 


e . ) ? et 
eae . ia's sti \ 


; » - 
er education provided quality gducation based on an analysis of each 


, 2 3 2 <2 
ei Eee 


'é role ahd-scope, resources, level of per capita expenditure, 


fancial aid, quality of Programs, service, number of i a of- 


ee apenas and Snee and vty of staff. Although the Me . 


~ : teddtetons, ‘ eaned go toftuence enrollment patterns: “Two! d#eticueddys 
4 1 
of higher education pi bomunely attracted minority. group Set 


“sIn compliance with HEW W directives, the State Council of Higher/Educa- 


. Li - 


tion drew upra four-part piah to suililes these enrollment patterns within 
1 « 

k, 

three years. Howevery as the Pfan stated: 


A young person's aspiration level is a product of a , SG 

' complex variety of factors. Among these factors is’ the 

; educational experience of th® young person’from kinder- 

. ; garten through Beco\dary school ... Therefore, the Council 
. : : will undgrtake ... a review of all teacher training pro- 
. . grams in Virginta's, state-supported Institutions of higher 
education. Primary consideration wj1l be given to the 
quality and amount of training which. teachers’ receive to | ‘ 
\ - prepare them to: teach minority group students with the ¢ 
ero: 7 _ greatest ae effectiveness. 
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ra FW The state, Associatio 


of Colleges of Teacher Education agreed to con- 


os 4 : ‘duct the study and appointed a Romie of three Deans si different four- ‘ 
. fees 08 8 f ’ . ’ 
a : year ingeitugions. Although each Dea was to, provide a faculty member to 


¢ - Be thats - 


assist, Tt was apparent that a large Committee would ‘impede rather shan: 


A facilitate the: study. A faculty .member at sah Chatvpeeaon® S- ahaa aia 


a wetth previous research experience in qualitative program evaluation at 
v: . 


. federal leyel and broad eivicaetniaak experience and training was assigned to 
: j ; : 


48 ~ the study. — es p 04 a 
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The Deans Committee served as the a experts" tid sounding ‘ 


a 


: cirndl wand official directors of the r} rudy. In rhean capacities, they sane- 


a | 


‘utaned the evaluation design proposgd:t " tiie éval ator. “Although Ehes gvalua- 


tor atteiided’ two Ascoctationmacstings when "tne st i was discussed prior to 


x anes 


. data collection, the Deans .Co mitted took the active role in advocating the 


study. The visibility of the eyaluator gradually faded-from the Association 


: a} . 0 . 
arid eventually from the Deans Committee meetings. When. the. completed study 


“was presented to the Association, the, evaluator wag’not present. The. study - 
. ' > % z . 


was.called a "Review" rather than an Se yatuntTon! of teacher ¢ education 


BESErens The study was anonymous neither the names. ‘of the Deans Comnittee 


. 


é 
nor the evaluator appeared on it. It was as though the uetiaientane 


had ‘too many unknown political implications for anyone other than thé As- 
‘sociation to claim authorship. . 
\ Ei ° 


Each Dean proposedan evaluation design ,at the first ar meeting. 
a Deans’ compfree was interracjal and each Dean represented a d{fferent 
_ kind of teacher education program. — Dean had a aifferent anptaath to 


"handling d study eh political iusttentbans 7 Dean aneined “ge study: 
\ . 
was'a yeplica of a previous study she had partic{pated in which focused on 


. 


Bex fiscrimination. She proposed a two category response -set (Yes-No) ques- 


¢ 


* etfonnaire on affirmatiye action. Through the slow process of concensus, the 
: ‘ 
. /focus” of the etyey was partially clarified. However, this Dean continued 


aiehne the two-year period to take bits position that asking Yes-No qucetions 

would suffice ina onlitteulttvatnttiabed study,;and that the less information 
*a teacher education program supplied to external agencies, the more protection 

‘this peovidud the’ program. © This vas dehonstrated further when she reduced 

7 to 14 pages of data on each of the fourteen teacher edutation programs 

to pete paragraph one each cae The Deans Committee ‘re- 


jected this draft of the evaluation report. 
, , ‘ a ? + 


ey | \ G: 


The Deans Committee took the position that since they . could not change ' 


‘o 


_ the political nature of the evaluation ‘question, then the study shodid demon- 


strate the complexities of program development ee chia vundqia 


aspects of each teacher education program. The Cemmittee aseuned that if 


- the fourteen saa education Programs were training teachers, ee work. ef-- 


x * - 


 fegtavely with salnieitey group students, each program “would diteaheas it 
uf 
_dffferently. Thus, a seven page questionnaire was developed, ‘to obtain. pate, 
° / ~ ; 
"qualitative and qeant Lennie’ ‘data. It focused on required , and optional ' ex- 


x 
periences for, 1i-service ahd pre-service teachets and demographic information 
\ 


. 


exit om the institution’ 8 euddant body and baiutty, Methods to establish iaberaed 


validity were built into the questionnaire. : j 


The nator evaluacien problem was one of criteria and whe fairness of 


, 


the critetia - how does one devetuine ifa besehes education program ‘is train- 


ing peackers to work effectively with minority group, studénts. What is the 


JA 
operationat definition of teaching: effectiveness in this er ‘Because 


, s * . pe Pe -» 
theke was no recognized criteria or definition in the Liteesncer,” nor among 


the Deans Committee, a Freliminary study was undertaken. Each of the fourteen 


teacher education programs was asked to describe briefly what ‘they “were doing 


in this area. ‘Indicators were then developed which could identify whether ak 


. ig 


Not teacher education programs were training teachers for such a purpose. ' One 
, 3 , . 


» 


limitation of the list of indicators was the lack of input from thé two’ teacher 


. 


education programs which attracted predominately minority group students. These 
. . x . - “ ’ ri 


two teacher education programs, because of the’ composition of their student 


‘ body, thought to report what their programs were dging to train teachers to 


aa : . 


,work effectively with minority group students was an-irrational request. ° 
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a3 The. Deans een alsortook the position that the aspiration levels 


4 


ee the niiiortty group students could not “ solely wbertuibed” to their ex- 


periences with teachere in K-i2 schops, ich less to teachor education pro- 


° 


eran . 


% 


“EW “questioned the relevancy of ‘tgacher, education programs” to changing minority re 


group enroliment pabieeia: in higher education. 


‘In fact, at mid-point through the - two-year’ evaluation pesneee even | 


” had directed the State Council of Higher Education to comply strictly with 


the 1974, plan which included the teview of teacher education programs 


- Ghe questionnaire was designed primarily to aid the participants in 


each teacher education program to assess, : theit own program in terms of 


<r preparing teachers to work effenvively with minority group students. 


plans. 


The 


’ ' 
* Participants would Jadge their program and identify netds and report future 


7 é ‘ 
Ideally, the state-wide study would ayothesize aud document the’ as- 


- Redbnent process by the fourteen prograns. - Although one may question ‘the 


av 


By now, fatesoaty the Bevennneen, i 


Ne BS of self-report assessment,” the "% knowledgeable group of any single 


teach 


ABeducation PReaeas was the participants. 


th addition, other al- 


erat if al data collection endangered the obtaining of any data! 


“ » 


ee e e 


S23 3 
ee ag 


Sree Focus si 


an 
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.°Y The evaliiatton focus, analyzed from an educational wien, was {logical 


“ 
and “riddled widiMassump tions 


The study assumed that teachers were’ the 


; "primary influencers, in raising aspiration. levels of wines group mbaients 


sf ‘one direction sm ~ to attend gauAte institutions of - hfgher ‘educat fon, 


Mt 


“Fron a political Viet Sg wendy became more logical. The State Council of ; 


j Wgher Education witch Sispasvit? the ay to 


tele MS 
re aye 
eyes : a 
Lyra, ‘ , os : 
Bie tL we, 
a L0 aN Py 
’ aan G 
ing 


HEW latked the resources and 


expertise to conduct a state-wide study on aspiration levels of minority 


. 
toy : 


group students or even on the inf®ence of public school teachers’ on minority . 


group ‘students. But, the State Council of Higher Education could obtain 


the cooperation of the state-supported teacher education programs to ‘study 


’ - . 


teacher preparation, Throughout the twoyear period, the Association of 


Colleges} of. Teacher Education first exhibited confusion over .the focus of 


“the study and then ipprehensively acquiesced to a comprehensive approach to. 


ve 
.* 


\ the study. 


Confusion over the evaluation focus occurred when the Deans Committee 


presented the proposed qyestionnaire at two general Association meetings. 


In the May 1975 ‘meeting, the Association members enthusiastically discussed 
for over an hour hew to conduct a study on minority group aspirations. The 

+ a | 
Deans suggested previous and ongoffig research on this topic... The Deans viewed 


the study as addin -to the body of knowledge about minority group aspirations - 


, any kind of aspirations and linked to,a number of varlables such ad SES, role 
¢ : . 


models, school activities, etc. 


i} 
* 


Slowly the Deans realized the study was not of ‘minority groups per se, 


\ 


but of their own feacher education ‘programs. As the political ramifications | 


,of the proposed study began, to dawn ‘on the Deans, a stillness pervaded the - 


’ 6 ~ 5 ® . 
room. The Deans then reviewed the proposed indicators which would identify 


teacher education | rograms which were training teachers to work effectively ° 


,with minority group students. Because thesc indicators were based on the 


° : ° i = ‘ 
preliminary study, each Dean found thdt some indicators described favorably 

‘ > . ‘ . . . i 
his/her program. Satisfied that’ the indicators “FE the Deans then 
made suggestions for revising the ‘proposed questiohyatre. 


. ‘ : se 
’ 
bad 


before the questionnaire, was to be sent to eac 


} perepecrive. 


' The. issue ‘arose again in the October 1975 Aésvciation mecting, ‘Just 
: 
Dean, Once again the Deans | 
€ 


a . ¢ > \ ' 
protested over the narrow evaluation focus on minority group students. No 


’ . 


“L progras had as its: sole’ mission’ to train teachers ‘£0 weer effectively, sai 


\ / . 
minarhhy group students. No program had\ A course called os eed 


¢ 


Ctdup Students." -Depending upon geographic location, Preiss and® the 


mission of the particular program and ifstitution, minority gould be sddheifiod 


as Appalachian, urban rural, white, or black, youth. If minority were tnt ved « 


\ . 
to the racial definition of the Civil oe ce Act o£ 1964, then some ‘programs, « 


on the surface ‘at least) nN appear Jsmavitectn, .A heated discussion for- 
lowed as Deans stated that their programs were to prepare tedchtes to wark 


with all Ceaiiedding * Since the political definition of minority could not be, 
changed, it was suggested euch Dean ‘suppl additional information senile 
the racial definition of ninority.and their own aoe tioa definition .of 

minority.- mS . : : . ; a. 


“, “oat 


Male 


At the heart’ of the- discussion was the palittenl verses educational, 


focus of the study. These teacher education program’ placed students in 


ree 
. - 


educational categories - remedial, exceptional, disadvantaged, and by school 


levels such as aid ees middle, and high school. Training teachers to 


{ 
-categorize students by race was. as outdated as‘ the Middle: Ages to these - 


Deans, yet they had to tiene their teacher seeeenpeian programs from thts 


= ’ 
' 


As a final note of protest, the Assdéciation, upon accepting @ff& com- 


‘ pleted 80 page report, voted to add a footnote-in Chapter One which stated: 


« 


Because this study’ was coriducted within the framework 
’ - of the State's Plan for Equal ortunity in Virginia's 


_  . Institutions of lligher Education, thetterm "minorgty" 


is used in a-manner consistent with that reporti Because “ 
‘ of the’ great variability ‘of institution “and locale, . Sty 
“ several of the ‘institutions represented in this study ; 
‘ “vifind it more appropriate to define minority" ‘in ‘terms ; sg 
o ; ‘other than racial categories, e. 8; academic ability, Sg ‘ 
*% achievement, social background, .@tc. Moreover, in our ‘4 "- 
\predominately Black gotleges, white student@ would be = 
identified as. the-primary minority population.” 
- > 


‘ 3 ° . 
. 
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! ; 
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» Data Qualit and, Nyltiple Kinds‘ of Data , . Pe SY , gee J 


in . . . 


‘ Most of thes fourtéen teacher shiek tion programs conpleted the ex- 


tensive ‘questionaire in a careful and thorough manner, denietecs tReir own 
programs and identifying needs and resources to, train. teachers to work 

«8 Sil 2 ‘e : . , ‘ y 
more ,effectively with minority group students.. One teacher ‘education program 


. <= ° ’ ; s. * 


appeared incapable of analyzing ts.program from this narrow perspective. 
: : - . : 
This program reported the findings in such a manner that it was extremely 


difficult for the evaluator to identify what was happening. 


Teacher education programs approached their self-assessment in dif-— . 


. 


ferent ways. Some described only pre-service education; others included 


{in-service and ‘continuing education; others reported that aspect of the 


- 


program which ‘most directly involved minority group students, such as special 


education. ‘ Some could not collect data on the number and racial composition, 


‘ 


of sophomore and/or junior education majors. Some analyzed their program; 7 
,othérs assumed that by supplying extensive data without synthesis, .that the ? 

‘ . . is 
data "spoke for itself." i? ‘ 


s 


The somplates study * ‘analyzed aacis Progran separately anid then identi~" 


fied the wot common practices er to cata tedchers te work ste ctwviaie 


. 


“with! minority group students. As the report stated: - ; ; | 


: te © . . < . ® ; 
* Both the diversity and the extensive amount of teacher preparation’to work 


.. Perhaps the most slpnifteunt findings, are that these ‘ 
teacher education progrdms are concerned about teacher . ol 
preparation for’ minority group instruction as ‘reflected . 
eo int program. goals and these teacher education programs 

use many and varied procedures to prepare pre-service 

= "and in-sexvice school personnel to work effectively * . 

with minority ‘group: pupils., ‘Both informal and shighly ra 

stryctured teacher lll processes, are systematidally - 

planned and’ assessed. a 


7 
| 


effectively with minority group student8-were documented. Teacher prepara- 
tion programs. seemed to vary with the insgitutional setting, including minor- 


but important variations in program goals,-and factors involved in using _ 


field-based experiences. = . : * 7. Pn. é 
° . % " . ° ' 


? a i 4 - : : 
Impact of the Study ‘ Bs ‘3 
is S ss ; a an 


An assessment: of the tnmediate inpact of the aby is tentative, » 


yet ee. a teacher education program became more ‘aware of the 


need to paepeay teachers: to mark effectively with’ minority group aCndenGs. 


oho 


Most programs LacheEib’ tucthee teacher preparation opportunities and ‘many ms, 
were already implementing plans. . The Association; once each Dean saw that 


} : ‘. oe 
the uniqueness and integrity of his/her Poggram was respected in the final 


study, was lauditory, "Comments from (the Association) ... members praised 
: ¢ . . 


oe. (the,study) ... as a substantial, ‘well-written’ and ‘on target! document, #u9 


The Neel had provided a valuablé service to ‘tlle, State Council 
ye iHigher Education. ‘The Council gratefully sent the’ windy to “MEW in- 


> - , 
dicating compliance with rederat, Loquesta Despite efforts .to verdatiee 
minority and ae eonteins about potential political ‘ram{ficat Lons of the i 

10 : id : i 
study, syetyone, banebieed, : . a : : oe \ . 


o +e - . ‘ 
. . ov 


. Yét, one wonders, |if the Study had originated from the Association . 
for program development px if teacher educatton prograns informally assessed 
: ee Oe ae : : P 5 


é “their progtams- from thiq perspective, what would have been-the impact? Did” 


"RORENEE education programs become concerned on this issue for only ‘the twoh 
, 4 i ene 


year period when the st ay was being conducted? Did the adnknignration ty 


=n faculties begradging iy review their programs, worthwhile as the analysis 


a might be, to complete a questionnaire and place 4 report on, the: shelf? Was 
the real impact siete stydy: me informal ohe - an sgn of the issue | : 
4 “A . and the ideas generated among faculties? Aictough one aight ‘argue that” a 
formal, study would not ee been i aes extermal intervention, one still @. 


questions’ the extent: to whieh \ politcal -aspects interfered with woteuticl 


etucattonst benefits. ; — oe ’ 


4 a .? oe : . 
Conclusions - { as P - * a 


; | ; < 
I do not want to suggest 4 false dy cotomy - that evaluation studies : 


are non~political nor: that policy-making questions have ligtle educational 


. 


vatua;” Instead, the evaluator, t ie parttcipating iuatteuclowe, and the - 


Seteroel agencies need to de seveicive to the issues invalved in asking 


oodiiitcell noeations of complex educational proressrs and programs. In ‘adastton, 


the study needs to delineate the interrelationships: i any single program to- 


* 


those societal fowees beyoftd the control of ddacavore wed make explicit. 


© the exact evaluation tows: This demands auatteative land : paeaiaaahaaaae data, 
12 


professional judgement, and a respect “for both the eficational iad patstical 


~peplications. Evaluation studies are not only to analyze and assess programs 
; U 


for internal use by the participants but also to inform extetnal publics of . 


the complexities of educational programs. 
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